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CLAIMS 

What is claimed is: 



1 1 . A method for encoding a specified neural system into a representative 

2 genome, wherein the neural system comprises an array of interconnected neurons and each 

3 neuron has an input and an output, said method comprising the steps of: 

4 for a given neuron, encoding a specification of the conversion of neuron input to 

5 neuron output by a processing gene corresponding to the given neuron; 

6 encoding the connections from the given neuron by one or more connection genes, 

7 each corresponding to the given neuron; and 

8 selectively ordering the processing genes and connection genes corresponding to 

9 respective neurons of the neural system to form said genome. 

1 2. The method of Claim 1 , wherein: 

2 said genome includes different types of processing genes and further includes 

3 different types of connection genes, each type of processing gene encoding a different type of 

4 neuron, and each type of connection gene encoding a different type of interaction between 

5 neurons. 

1 3 . The method of Claim 2, wherein: 

2 a processing gene encodes a neural output function for its corresponding neuron, 

3 wherein the encoded neural output function provides neuron output as a specified function of 

4 collective neuron inputs. 

1 4. The method of Claim 3, wherein: 

2 a neural output function encoded in a processing gene is encoded in the form of a 

3 mathematical expression tree having internal nodes and leaf nodes, said internal nodes 

4 representing a set of mathematical operators, and said leaf nodes representing a set of 

5 terminal inputs to said mathematical expression tree. 
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1 5. The method of Claim 2, wherein: 

2 said method includes the step of performing mutation operations on selected 

3 processing genes and selected connection genes. 

1 6. The method of Claim 5, wherein: 

2 a group of genes of said genome can be exchanged with a group of genes of another 

3 genome that likewise comprises processing genes and connection genes. 

1 7. The method of Claim 2, wherein: 

2 each of said connection genes encodes the location of a neuron connection to another 

3 neuron, and further encodes a weight associated with the connection. 

1 8. The method of Claim 7, wherein: 

2 each of "said connection genes can be mutated. 

1 9. The method of Claim 3, wherein: 

2 each of said connection genes is subdivided into a specified number of components, 

3 each component comprising a functional capability. 

1 10. The method of Claim 9, wherein; 

2 one of said components comprises a strength sub-gene encoding a weight function 

3 that determines the weight of a corresponding connection. 

1 11. The method of Claim 1 0, wherein: 

2 said strength sub-gene is represented by a mathematical expression tree having an 

3 associated set of operators. 
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1 12. The method of Claim 1 1 , wherein: 

2 at least one of said operator sets includes one or more operators for enabling the 

3 neural system to reconfigure its neuron connections. 

1 13. The method of Claim 12, wherein: 

2 said operators for reconfiguring connections comprise a first operator for creating 

3 new neuron connections, and a second operator for removing neurons and neuron 

4 connections. 

1 14. The method of Claim 13, wherein: 

2 a first operator in a processing gene selectively directs a neuron to make one new 

3 connection for each one of its connection types, and a first operator in a strength sub-gene 

4 selectively directs a neuron to make a new connection only of that sub-gene's type. 

1 15. The method of Claim 1 3, wherein: 

2 a second operator in a processing gene removes neurons and connections from the 

3 neural system, and a second operator in a strength sub-gene removes only that sub-gene's 

4 connection. 

1 16. The method of Claim 2, wherein: 

2 each of said connection genes includes a plurality of parameter sub-genes, each 

3 parameter sub-gene disposed to encode either a specified value, or a mathematical expression 

4 tree, selectively. 

1 17. The method of Claim 1 6, wherein: 

2 one of said parameter sub-genes comprises a count sub-gene, said count sub-gene 

3 specifying the number of connections of each type made by each type of neuron. 
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1 18. The method of Claim 1 6, wherein: 

2 said parameter sub-genes include direction and range sub-genes that collectively 

3 determine where each connection to a neuron goes. 

1 19. The method of Claim 1 6, wherein: 

2 one of said parameter sub-genes comprises a target sub-gene indicating the kinds of 

3 neurons that respective connections are to link with. 

1 20. The method of Claim 16, wherein: 

2 said method includes the step of mutating said sub-genes, selectively, of said 

3 connection genes. 

1 21. The method of Claim 1 1 , wherein: 

2 a processing gene and a strength sub-gene each encodes an output function having a 

3 specified form and corresponding inputs, at least one of said output functions being 

4 responsive to positive reinforcement and negative reinforcement signals applied to its 

5 corresponding inputs for use in selectively training said neural system. 

1 22. A method for building a neural system for use in a specified application, said 

2 method comprising the steps of: 

3 encoding a genome to represent one or more types of neurons in an array, and to 

4 further represent one or more types of interactions between said neurons; 

5 inserting said neurons encoded in said genome into said neural system as input 

6 neurons, the initial number of said input neurons being determined at least in part by said 

7 application; 

8 selectively building connections between respective input neurons; and 

9 selectively creating new neurons. 
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1 23. The method of Claim 22, wherein: 

2 each neuron represented by said genome has a neural output function encoded by a 

3 processing gene, wherein different types of neurons are respectively encoded by different 

4 types of processing genes; and 

5 each of said interactions between neurons is encoded by a connection gene, wherein 

6 different types of interactions are respectively encoded by different types of connection 

7 genes. 

1 24. The method of Claim 22, wherein: 

2 said encoded representation of one or more types of interactions between said neurons 

3 specifies the number of connections to build, determines a target area in which a connection 

4 is to be made, and indicates the type of neuron that a connection is to be made to. 

1 25. The method of Claim 24, wherein building a neuron connection comprises: 

2 selecting a first location within a specified target area; 

3 forming a connection with a neuron found at said first location, if the found neuron is 

4 of a specified type; 

5 selecting a second location to search for a neuron, if a neuron found at said first 

6 location is not of said specified type; and 

7 creating a neuron of said specified type at said first location, if no neuron can be 

8 found at said first location. 
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1 26. The method of Claim 25, wherein: 

2 said encoded representation of said interaction between said neurons selectively 

3 specifies one or more conditions selected from a group, said group including the conditions 

4 that a neuron of said specified type is created only if a pre-existing neuron of said specified 

5 type cannot be found anywhere in said specified target area; a connection to a pre-existing 

6 neuron of said specified type is made only if empty spaces in which to create new neurons 

7 cannot be found anywhere in said specified target area; creation of new neurons is not 

8 allowed; and connections to pre-existing neurons are not allowed. 

1 27. The method of Claim 26, wherein: 

2 creation of a new neuron requires creation of one or more new connections therefor, 

3 said new connections either linking to previously existing neurons or creating new post- 

4 synaptic neurons; and 

5 said connection creation process continues until every new connection is either made 

6 to a previously existing neuron, or a pre-set limit on the maximum number of neurons in the 

7 neural system is reached. 

1 28. The method of Claim 27, wherein: 

2 upon completion of said neural system, a set of the last neurons to be created are 

3 designated as output neurons. 

1 29. The method of Claim 28, wherein: 

2 said neural system contains a substantial number of different circuitry combinations. 

1 30. The method of Claim 29, wherein: 

2 said neural system comprises an array having a specified number of dimensions. 
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1 3 1 . A method for developing a neural system adapted to perform a specified task, 

2 said method comprising the steps of: 

3 selecting a population of neural systems, each neural system comprising an array of 

4 interconnected neurons; 

5 encoding each neural system into a representative genome, wherein the genome for a 

6 given neural system encodes a neural output function for each neuron in a corresponding 

7 processing gene, and encodes the connections from each neuron in one or more 

8 corresponding connection genes, each connection gene including a weight function; 

9 operating said given neural system to perform said specified task during a trial period; 

10 continually monitoring performance of said given neural system during said trial 

1 1 period; 

12 applying reinforcement signals determined from said continually monitored 

13 performance as inputs to the neural output function of each processing gene of said given 

14 neural system, and also as inputs to the weight function of each connection gene thereof; and 

15 determining the fitness of said given neural system for performing said specified task 

16 after the conclusion of said trial period. 

1 32. The method of Claim 3 1 , wherein: 

2 said reinforcement signals include a positive reinforcement signal PR t and a negative 

3 reinforcement signal NR t received at a time step t included in a total number of time steps T. 

1 33. The method of Claim 32, wherein: 

2 the fitness F of said given neural system for performing said specified task is 

3 determined from the relationship. ^ 

F=Y J (PR t -NR t ). 

teO..T 
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1 34. The method of Claim 33, wherein: 

2 a set of said genomes, respectively representing the neural systems of said population 

3 determined to have the highest fitness values, are selected for use in forming a new 

4 generation of neural systems. 

1 35. The method of Claim 33, wherein each genome is subjected to a succession of 

2 selection trials, and is periodically tested to detect loss of previous adaptations. 

1 36. The method of Claim 35, wherein: 

2 each of said selection trials is disposed to develop characteristics associated with 

3 intelligence. 

1 37. A computer system for encoding a specified neural system into a 

2 representative genome, wherein the neural system comprises an array of interconnected 

3 neurons and each neuron has an input and an output, said computer system comprising: 

4 one or more processors; and 

5 a computer readable medium connected to the processors, said computer readable 

6 medium including processor instructions configured to be read by said processors and 

7 thereby cause said processors to: 

8 for a given neuron, encode a specification of the conversion of neuron input to neuron 

9 output by a processing gene corresponding to the given neuron; 

10 encode the connections from the given neuron by one or more connection genes, each 

1 1 corresponding to the given neuron; and 

12 selectively order the processing gene and connection gene corresponding to 

13 respective neurons of the neural system to form said genome. 
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1 38. The computer system of Claim 37, wherein: 

2 said genome includes different types of processing genes and further includes 

3 different types of connection genes, each type of processing gene encoding a different type of 

4 neuron, and each type of connection gene encoding a different type of interaction between 

5 neurons. 

1 39. The computer system of Claim 38, wherein: 

2 a processing gene encodes a neural output function for its corresponding neuron, 

3 wherein the encoded neural output function provides neuron output as a specified function of 

4 collective neuron inputs. 

1 40. The computer system of Claim 38, wherein: 

2 said method includes the step of performing mutation operations on selected 

3 processing genes and selected connection genes. 
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